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1 Introduction 

High dimensional array data, that is, tensor data, are becoming important recently in var- 
ious application fields (for example see Miwakeichi et al. UMIL Vasilescu and Terzopou- 
los HVT1I and Muti and Bourennane [MB]). A p-tensor is an element of F" 1 <g>F" 2 <g>- • -0F"'', 
where F is the real or complex number field and n\, n 2 , . . . , n p are positive integers. 
It is known that every p-tensor can be expressed as a sum of p-tensors of the form 
a\ <8> a 2 <S> • • • ® a p . The rank of a tensor x is, by definition, the smallest number such 
that x is expressed as a sum of the tensors of the above form. Since there is a canoni- 
cal basis in F" 1 <g> ■ • ■ <S> F" p , there is a one to one correspondence between the set of all 
p-tensors and the set of ^-dimensional arrays of elements of F. In particular, 3-tensor 
can be identified to A = (A\\ A 2 ; • • • ; A nj ), where each A, is an n x x n 2 matrix. The rank 
of a tensor may be considered to express complexity of the tensor. The factorization of 
a tensor to a sum of rank 1 tensors means that the data is expressed by a sum of data 
with most simpler structure, and we may have better understanding of data. This is an 
essential attitude for data analysis and therefore the problem of tensor factorization is an 
essential one for applications. For modelling data, the maximal rank of "a set of tensors" 
(model) is also crucially important, because an excessive rank model is redundant and 
deficient rank model can not describe data fully. In this paper we consider the maximal 
rank problem of 3-tensors. In the following by T(a,b,c) or simply F axfexc we denote the 
set of all tensors with size axb x c, and by max.rank F (a, b, c) denotes the maximal rank 
of all tensors in T(a, b, c). Note that in this paper F is C, the complex number field, or R, 
the real number filed. Atkinson and Stephens HASH and Atkinson and Lloyd HALM devel- 
oped a non-linear theory based on their own several lemmas. Basically they estimated the 
bounds by adding two diagonal matrices which enables the two matrices diagonalizable 
simultaneously. They did not solve the problem fully, and restricted the type of tensors 
for obtaining clear cut results. They obtained max.rankc(p, n, n) < (p + l)n/2 for an even 
p and [p/2]n under the condition that f(A u . . . , A p ) = det(£f =1 /l;A ; ) is as a polynomial in 
C[Ai, . . . , A p ] not identically zero and has no repeated polynomial factor. However they 
treated the problem over the complex number field. The aim of this paper is to give upper 
bound over the real number field. We traced their method and tried to rephrase their result 
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to the real number field. It should be noted that the problem becomes difficult for the 
real field because the characteristic polynomial of a matrix dose not necessarily have real 
roots. In this paper we will report some generalization of Atkinson and Stephens HASH 
and Atkinson and Lloyd HALL In Section we first consider the real versions of several 
lemmas treated in the complex number field in the two papers, and by which we show two 
main theorems, Theorem 13.41 and Theorem 13 .71 which are slight extensions of Theorem 

1 in Atkinson and Stephens HASH and Theorem 1 in Atkinson and Lloyd [ALU respec- 
tively. In Section HI we will prove the statement without proof given by Atkinson and 
Stephens HASH : max.rank c (n, n, 3) < In - 1 and max.rank c (n, n + 1 , 3) < In. And we will 
prove the real version of these under some mild condition. See Theorems l4.5l andl 4.8l As 
an application of this result, we will prove, for the relatively small size of tensors from 
7/(3, 3, 3) to 7/(6, 6, 3) the upper bound are given. We also give an upper bound for a more 
general type of tensors in T{n, m, 3) in case n < m: max.rank F (n, m, 3) < n + m - 1. This 
improves the result of Atkinson-Stephens (see Theorem 14 .8 1) . 

2 Preliminaries 

We first recall some basic facts and set terminology. 

Notation (1) By F, we express the real number field R or the complex number field C. 

(2) For a tensor ieP8P'8 ¥ p with x — Yjijk a ijk&i ® &j ® ^/b we identify x with 
{Ay, ■ ■ ■ ;A P ), where A k = {ajjk)\<i< m ,\<j<n for k = 1, . . . , p is an m x n matrix, and 
call {Ay; • • • ;A P ) a tensor. 

(3) For anmxwxp tensor T = {Ay; ■ ■ ■ ;A P ), I x m matrix P and n x k matrix Q, we 
denote by PTQ thelxkxp tensor {PA X Q; • • • ; PA p Q). 

(4) For an mxnx p tensor T = (Ai; • • • ; A p ), we denote by T T the n x m x p tensor 
{A\\ • • • \A p ). 

(5) For p m x n matrices A\, . . ., A p , we denote by (Ai, . . . ,A P ) the mxnp matrix 
obtained by aligning A\, . . . , A p horizontally. 

(6) For m x n matrices A\, . . ., A p , we denote by {A\, . . . ,A P ) the vector subspace 
spanned by Ay, . . . , A p in the F- vector space of all the m x n matrices with entries 
inF. 

(7) For an m x n matrix M, we denote the m x j (resp. mx{n- j)) matrix consisting of 
the first j (resp. last n - j) columns of M by M<j (resp. j<M). We denote the i x n 
(resp. (m - i) x n) matrix consisting of the first i (resp. last m - i) rows of M by M-' 
(resp. 1< M). For integers iy, . . ., i r and jy, j s with 1 < iy < • • • < i r < m and 
1 < jy < • •• < j s < n, we denote the r x s matrix consisting of z'rth, zyth, . . . , / r -th 
rows and ji-th, j'2-th, . . . , j>th columns of M by 3""' . } . 

(8) We denote by the matrix unit whose entry in {i, j) cell is 1 and otherwise. 
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Definition 2.1 Let x be an element of F m ® F" <g> W. We define the rank of x, denoted 
by rank*, to be min{r | 3a t e F m , 3b j e F", 3c j e ¥ p for i = 1, r such that 
x = Y! i= \ a i ® <8> Ci). max{rank x \ x e F m <g> F" ® F p } is denoted by max.rank F (m, n, />). 

It is clear from the definition that rank (x + y) < rank x + rank y for any jje F'" <S> F" ® F p . 

Definition 2.2 For a matrix A = (a,y) we set supp(A) := {(/, j) | a,j ^ 0} and call it the 
support of A. 

The following lemmas are easily verified. 

Lemma 2.3 Let (A\ \ ■ ■ • ;A P ) be an m x n x p tensor. Then rank(Ai; • • • ;A P ) = min{r | 
3Ci, . . . , C r such that C,- is a rank 1 matrix and {A\, . . . , A p ) c {C\ , . . . , C r )}. In particular, 

(1) if(A u ...,A p ) = (B u ...,B q ), thenrax±(Au--- ;A p ) = rax±(B l ;- ■ ■ ;B q ), 

(2) for any non-singular matrices P and Q of size m and n respectively, rank {A\ ; • ■ • ; A p ) = 
rank {PA\ Q; • • • ; PA P Q) and 

(3) rank(A[; • • • ;A T p ) = rank(Aj; ■ • ■ ;A P ). 
Lemma 2.4 rank (A Y ; • • • ; A p ) > rank (A Y , . . . , A p ). 

From now on, we denote rank R or rank c instead of rank to specify over which field, R 
or C, we are working. For the statements common to both fields, we use rank F . 
The following lemma is well known. 

Lemma 2.5 Let 

f(A) =A n + a x X n ~ x + ■ ■ ■ + a„ 

be a monic polynomial with a variable A and coefficients in F. Suppose that f(A) = has 
n distinct roots in F. Then there is a neighbourhood U of a = (a\,a,2,..., a n ) T in F" such 
that for any x = (x\, x%, . . . , x n ) T e U, 

A" + jcii' 1 " 1 + • • • + x n = 

has n distinct roots in F and these roots are continuous function of x. 

3 Maximal rank over the real number field 

In this section we show results in the real number field which are obtained by Atkinson 
and Stephens HASH and Atkinson and Lloyd PAL] in the complex number field. We show 
the several results which is along with the results given by them, but the results are slightly 
different and some of them are new one. Now we prepare several lemmas which is a real 
version of Lemma in Atkinson-Stephens HASH . First we show the extended version of 
Lemma 3 in HASL 

Lemma 3.1 Let A = (aij) and B = (bij) be n x n matrices with entries in F. Then there 
exist diagonal matrices X, Y with entries in F satisfying the fallowings. 
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(1 ) A + X is non-singular. 

(2) (A + Xy l (B + Y) has n distinct eigenvalues in F. 

Moreover ifi h . . ., i r are integers with 1 < i\ < • • • < i r < n, A~j?" '")•'[ is non-singular and 

^={h \ r p _1 (-®={/! ty has t distinct eigenvalues in F, then we can take X and Y so that 
the entries of the (i u , i u ) cell ofX and Y are zero for u = 1, . . . , r. In particular, 

(a) if(n, n) e supp(A), then we can take X and Y so that the entries of the in, n) cell of 
X and Y are 0. 

(b) if{(n - \,n),(n,n - 1)} c supp(A), in, n) i supp(A) U supp(5) andb n -\^ n ja n -\ fl ± 
b n ,n-\ I ®n,n-\, then we can take X and Y so that the entries of the (n - l,n— 1) and 
(n, n) cells ofX and Y are 0. 

Proof First we prove the former half of the lemma. Take distinct elements s\, . . . , s n of 
F and set D = Diag(^i, . . . , s n ). Note that if the absolute values of all entries of A' are 
sufficiently small, then A' + E n is non-singular and all entries of (A' + E n )~ l are continuous 
with respect to entries of A'. Thus (A' +E n )~ 1 (B' +D) is a continuous function with respect 
to A' and B' if the absolute values of their entries are sufficiently small. Since 

det(AE n - (A' + E n y\B' + D)) = 

has n distinct roots s\, s 2 , ■ ■ ■, s n in F if A' = B' = O, we see by Lemma 1231 that there is a 

2 

neighbourhood of O in F" such that if A' and B' are both in it, then 

det(AE n - (A' + E n y\B' + D)) = 

has n distinct roots in F. Hence for sufficiently small e > 0, 

det(AE„ - (eA + E n y\eB + D)) = 

has n distinct roots in F and therefore 

detU(A + (l/e)E H ) - (B + (l/e)D)) = 

has n distinct roots in F. So it is enough to set X = (l/e)E„ and Y = (1 /e)D. 

Next we prove the latter half of the lemma. By permuting the rows and columns 
simultaneously, we may assume that i\ = 1, . . . , i r = r. Set 




'A n A 12 \ B l*n B u \ 

A 2 1 A 2 2/' \-B 2 l ^22/' 



where A n and B n are r x r matrices. Then, by assumption, A u is non- singular and 
(An) -1 !?!! has r distinct eigenvalues, say s\, . . . , s r , in F. We take n — r distinct elements 
s r+ \, s„ from F \ {si, . . . , s r } and set 

£>i = E n _ r , D 2 = DiagO r+ i, . . . , s n ). 
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Then by the same argument as in the proof of the former half, we see that 
is non-singular and 

-i 
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we see that it is enough to set X = e~ 2 Diag(0, £>i) and Y = e~ 2 Diag(0, D 2 ). I 

The following result is well-known but we write a proof in convenience. 

Proposition 3.2 Ifn > ab, it holds 

max.rank F (a,£,n) = ab. 

Proof It is clear from the definition that max.rank F (a, b, n) = max.rank F (R, a, b). If A = 
(Ai;A 2 ; • • • ;A^) is annxaxb tensor, then it is also clear from the definition that rank F A > 
rank F (Ai,A 2 , . . . , Ab). So we see that max.rank F (n, a, b) > ab. 
Next, let A = (o,^) be an arbitrary 3-tensor. Then 

a b 

A = 2_j /_j e ' ® e i ® fafl ' ai J 2 > a ^) T ■ 
i=\ j=l 

Therefore, rank F A < ab. I 



We can show the real case of Lemma 4 in [AS J. 

Lemma 3.3 (cf. Lemma 4 [ AS]) Let X and Y be an n x n matrix such that X is non- 
singular and each wot of det(AX-Y) = is in F and not repeated. Then for any nx(m-n) 
matrices U and V, it holds that 

rank F (X,C/; Y,V) < m. 
Proof We can apply the proof of Lemma 4 HASH . I 



The following theorem is a slight generalization of Theorem 1 in HAS 
Theorem 3.4 Let n <m and F = R, C. 
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m(j~> — 1) 

(1 ) if p is odd, it holds max.rank F (n, m, p) < n H . 

m(p — 2) 

(2) if p is even, it holds max.rank F (n, m, p) < 2n H and in addition ifm = n, 

n(p + 2) 

it holds max.rank F (n,n,/?) < 1. 

Proof Let A = (Ai; . . . ; A p ) e j?" xm xp. There is non-singular matrices P and 2 and integer 
r < n such that PA P Q = ^j. Then letting Bj = PAjQ for each j = 1, we have 

rank F (Ai; • • • ;A P ) = rank P (Bi; • • • 

Let D p = B p and D y = (ZX, 0)be nxm matrices with diagonal matrices ZX for 1 < j < p 
such that (5 2 ;_i)<„ - and (B 2 i)< n - D' 2i satisfy the conditions of[(T)]and[(2)]of Lemma 
Ofor i = 1, . . . , l(p - 1)/2J. Then it holds 

rank F (A) < rank F (Z>i; ■■■ ;D P ) + rank F (5i - D x ; ■ ■■ ; B p . x - D p ^;0). 

Thus for odd integer i = 1, 3, 5, . . ., we obtain rank F (fi, - Z),; - A+i) ^ by Lemma 
13.31 Thus if p is odd, we have 

rank F (A) < n + rank F (5i - D x ; B 2 - D 2 ) + ■ ■ ■ + rank F (5 p _ 2 - D p . 2 \ B p . Y - D p ^) 

m(p - 1) 

< n H 

2 

and otherwise 

rank F (A) < n + rank F (5i - Di,B 2 - D 2 ) + ■■■+ rank F (5 p _i - D p _i,0) 

m(p - 2) 

< n H h n. 

2 

n(p — 2) n(p + 2) 
Furthermore, if p is even and m = n, then rank F (A) <2n-\ 1 = 1 

since we can take D p -\ so that rank (B p -\ - D p -{) < n - 1. 1 



Lemma 5 and Theorem 2 of [ASJ are also true over the real number field whose proofs 
are quite similar. 

Lemma 3.5 (Lemma 5 HASP Ifk<n, then 

max.rank F (m, n, mn - k) = m(n - k) + max.rank F (m, k, mk - k). 
Theorem 3.6 (Theorem 2 KSlO Ifk <m<n, then 

max.rank F (m, n, mn - k) = mn - k 2 + max.rank F (fc, k, k 2 - k) 
Theorem 1 by Atkinson-Lloyd HALII is also slightly generalized. 
Theorem 3.7 Let n < m. If p is even, it holds 

max.rank F (n,m,p) < h n. 



Proof Let A = (A x \ ■ ■ ■ ;A P ) e F nXmx P. By llSMSl Corollary 3.10], there are tensor T 
and non-singular matrices P and Q so that rank^T^; T 2 ) < m/2 and P(A p - T{)Q and 
P(A p .\ - T 2 )Q are both of form (D, O) with some diagonal matrix D. Set Bj = PAjQ for 
j = 1, . . . , p - 2, = P(A p _! - T 2 )2, and D p = P(A p - T X )Q. For diagonal matrices 
Dj(j = l,...,p-2), we have 

m 

rank F (A) < rank • • • ; 5 p _ 2 ; D p _ x ;D p ) + — 

m 

< rank F (Bi - D x \ ■ ■ ■ ; 5„_ 2 - D p . 2 ; 0\ O) + rank F (Di; ■■■ ;D P ) + — 



(p-2)/2 



2 



Z, , „ ^ „ ^ N 2n + m 

rank F (5 2; _! - D 2hl ;B 2j - D 2j ) + — - — . 

7=1 



Thus by Lemmas IBTTl and 1331 we have 

m(v — T) 2n + m m(p-l) + 2n 
rank F (A) < + — - — = 

for some D\, D p - 2 . 1 

4 max.rank(m, n, 3) 

In this section, we give a proof of the following statement (Theorem 14.11) asserted in 



HASH without proof. In fact, we prove more general statements over C and, under mild 
condition, over R also. See Theorems 14.51 and 14.81 

Theorem 4.1 ( RSH ) 

max.rank c (n, n, 3) < 2n - 1 and max.rank c (n, n + 1,3) < 2n. 

We begin with the following lemma. 

Lemma 4.2 Let m be an integer with m > 2. If a.\, . . . , a s , b\, . . . , b t are m- dimensional 
non-zero vectors andA\, . . . , A u , By, . . . , B v are m x 2 matrices of rank 2, then there is a 
non-singular matrix P such that any entry of Pat (i = 1, . . . , s), bJP~ l (i = 1, . . . , t) and 
any 2-minor ofPAj (i = 1, . . . , u) and BjP~ l (i = 1, . . ., v) is not zero. 

Proof Let X = be an m x m matrix of indeterminates, i.e., {x !J }" 1 /=1 are independent 
indeterminates. None of the following polynomials of x t j is zero, where Cof(X) is the 
matrix of cofactors of X. 

• detZ. 

• 7-th entry of Xa ( . 

• j-th entry of bJCof(X). 

• 2-minor of XA t consisting of j-th and fc-th rows with 1 < j < k < m. 

• 2-minor of BjCof(X) consisting of j-th and k-th columns with 1 < j < k < m. 
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So the product /(xj ; ) of all the above polynomials is not zero. Since F is an infinite field, 
we can take p t j e F so that f(pij) £ 0. Then it is clear that P = (p^) meets our needs since 
P~ l = (detP) _1 Cof(P). I 

In order to estimate the rank of nx nx3 tensors, we prepare the following lemmas. 

Lemma 4.3 Let (Ai;A 2 ;A 3 ) be an m x n x 3 tensor with m < n such that At, = (D, O) 
where D is a diagonal matrix with entry in (m,m) cell and (Ai)< m , (A 2 )<„, satisfy the 
condition of (a) or (b) of Lemma 13.71 Then rankp(Ai;A 2 ; A3) < m + n — 1. 

Proof By Lemma |3~T1 there are m x m diagonal matrices £>i and D 2 with entry in (m, m) 
cell such that (Ai + (Di, 0))< m is non-singular and {{Ai + (D\, 0))< m )~ l {{A 2 + (D 2 , 0))< m ) 
has m distinct eigenvalues. Therefore by Lemma [331 

rank F (Ai;A 2 ;A 3 ) 

< rank F (A! + (D u 0);A 2 + (D 2 , 0); O) + rank F (-(£>i, O); -(D 2 , 0); A 3 ) 

< n + m - 1. 



Lemma 4.4 Let n be an integer with n > 3 and A\, A 2 n x n matrices with (n,n) <£. 
supp(Ai) U supp(A 2 ). Suppose that {A\) ={n] £ and (Ai) =|n| ± r and for any t e F, 
(tA\ + A 2 ) = [ n ] ^ or (tA\ + A 2 ) =M + r . Then there is a non-singular (n — 1) X (n — 1) 
matrix P such that A = Diag(P, l^DiagCP, l)' 1 and B = DiagCP, l)A 2 Diag(7 : ', 1) _1 satisfy 
the condition of(b) in Lemma 1X71 

First assume that rank(ai,a 2 ) = 2. Then by Lemma I4~2l we see that there is a non- 
singular (n-l)x(n-l) matrix Q\ such that any entry of Q\d\ and &[<2[' and any 2-minor 
of Qi(a u a 2 ) is not zero. Set Qi(a u a 2 ) = (a, 7 ) and (b u b 2 ) T Q~ l = (Z?, 7 ). If (a„_ u , a„_i, 2 ) 
and (fei,„_i, b^n-i) are linearly independent, then P = Qi meets our needs since 

Diag( Ql , DAPWQu I)" 1 = Q f) ■ 

If (fln-i,i,a B -i,2) an d (bi, n -i,b2,n-i) are linearly dependent, then (ta n - 2 j + a n -\,\, ta n - 2 , 2 + 
a„_i >2 ) and (&i, n -i,&2,n-i) are linearly independent for any ( e F \ |0( since (a n -2,i, cin-2,2) 
and a„_i j2 ) are linearly independent by the choice of <2i- Choose ? e F \ {0} so that 

ta„_ 2j i + a„-u ^ and set Q 2 = E n _ x + tE n ^^ 2 . Then P = <2 2 <2i meets our needs since 

Diag( &e „ IHDiagCfce,, 1)- = ( &G '<fg^' ' 2 f "') 

and Qj 1 = E n .i - tE n „ Un „ 2 , the (n - l,ri) entry of Diag(j2 2 <2i, l)AiDizLg(Q 2 Qu 1) _1 is 
?a„_ 2j i + a n -u and (n, n - 1) entry of Diag(<2 2 <2i, l)A,Diag(<2 2 <2i, I) -1 is b ifl -\. Therefore 
we have proved the case where rank (a.\, fl 2 ) = 2. 

We can prove the case where rank (bi,b 2 ) = 2 by the same way. 
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Now assume that rank (a\, a 2 ) = rank(Z>i, Z> 2 ) = 1. Choose as before, a non-singular 
(n - 1) X (n - 1) matrix Q\ such that any entry of Q\d\ and b\Q\ l is not zero and set 
Qi(a 1 ,a 2 ) = (dij), (b l ,b 2 ) T Q~ 1 = (^7). Then a„_i >2 /a n _ u * & 2 ,„-i/&i,„-i, since otherwise 
-a^-i^/On-i.iai + a 2 = -& 2 ,n-i/^i,n-i«i + «2 = -b2,n-\lb\, n -\bi + b 2 = 0, contradicts the 
assumption. Therefore P = Qi meets our needs. I 

Now we state the following 

Theorem 4.5 Lef T = (Ai;A 2 ; A3) be an n x n x 3 tensor. If(A\, A 2 , A3) contains a non- 
zero singular matrix, then rank F r < 2n — 1. In particular, if¥ = C or n is odd, then 
rank F r < 2n — 1. 

Proof We prove by induction on n. 

Since max.rank F (l, 1,3)= 1 and max.rank F (2, 2, 3) = 3, we may assume that n > 3. 
By Lemma 1231 and the assumption, we may assume that A 3 = Diag(£V, O) with r < n and 
supp(Ai) D supp(A 2 ). 

If e supp(Ai) for some (i,f) with i > r and j > r, by permuting rows and 
columns within (r + l)-th, . . . , n-th one, if necessary, we can apply Lemma 1431 Therefore 
rank ¥ T <2n - \ . 

Now assume that (i, j) £ supp(Ai) for any i, j with i > r and j > r. Set r< (A ! -)" r = A 12l - 
and r< (A,)< r = A 2 u- If there is a column vector of Ai 2 i which is 0, then rank F r < n + n-l 
by Lemma 1331 since T is essentially an « x (n - 1) x 3 tensor in this case. Therefore we 
may assume that no column vector of A m is 0. We may also assume that no row vector 
of A 2 n is r . 

Set A 12i - = (a !>+ i, . . . , a in ) and A\ u = (Z>,>+i, . . . , b in ). Assume first that there is j > r 
such that aij, a 2 j are linearly independent. Then by exchanging the (r + l)-th and the 
j'-th columns, we may assume that (Ai)^J and (A 2 )^*j satisfy the condition of Lemma 
14.41 So we take the non-singular r x r matrix P of the conclusion of Lemma \4A\ and set 
Diag(.P, E n . r )A k T>'mg{P, E n _ r )~ x = (a m ). Then a r+ \ r+ \ k — for any k and a r r+ \ 2 /a r r+ \ i ^ 
^ f -+i,r,2/«r+i,r,i- Therefore, by exchanging the (r + l)-th and the n-th rows and columns, and 
exchanging the r-th and the (n - l)-th rows and columns, if necessary, we may transform 
Diag(.P, E n - r )(Au A 2 ; Ai)Diag(P, E n - r )~ l to a tensor which satisfy the condition of Lemma 
14.31 (we do not need the permutation if r = n — 1). So the conclusion follows by Lemma 
14.31 The case that there is j > r such that by, by are linearly independent is proved by 
the same way. 

Next assume that ay, a 2 j are linearly dependent and b\j, by are linearly dependent 
for any j > r. 

Since the vector space spanned by the column vectors of (Ai)^ +1 is at most r and the 
last column of (Ai)^. r r+l is not zero, we see that there is j with 1 < j < r such that j'-th 
column of (Ai)^. r r+l is a linear combination of the columns of y<(Ai)^ +1 . Therefore we see 
that there is an (r+ l)x(r+ 1) lower triangular unipotent matrix V such that ((A!)< r+1 V)% = 
((Ai)<^ +1 V)< r has a column vector which is 0. So by the induction hypothesis, 
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rank F r 
= rank F (Ai;A 2 ;A 3 ) 

= rank F (AiDiag(V, £„_ r _i); A 2 Diag(V, E n _ r _ r ); A 3 Diag(V, E n ^)) 

< rank F mi)< r+ iV)t r ; ((A 2 )< r+1 V)f r ; ((A 3 )< r+1 V)f r ) 

n n 

+ J] rank F (a l7 ;a 2i ;0)+ £ rank F ((Z>[ ; ,0)V;(& 2; -,0) r V;0 r ) 

j=r+l j-r+\ 

< 2r — 1 + (ft — r) + (n - r) 
= 2n- 1 

since rank F (ai ; -; a 2; -; 0) < 1 and rank F (Z>[ / .; Z>2 ; .; r ) < 1 for any j with j > r. I 

Next, we consider the non-square case. First we prepare the following lemmas. 

Lemma 4.6 Let A and B be n x n matrices, a = («],..., a„) r anJ Z> = (&],..., Z?e 
n-dimensional vectors. Suppose at ± for any i = 1, n. Then there are diagonal 
matrices X and Y and a vector p such that 

(1) A + X is non-singular, 

(2) (A + X)p = a and (B + Y)p = b. 

Moreover, ifb\la\, . . . , b„/a n are distinct each other, then we can take X and Y so that 
(A + X)~ l (B + Y) has n distinct eigenvalues in F. 

Proof Set A = (a, ; ) and B = (bij). For < e e R, we set 

n 

7=1 
n 

bi(e) = bi-e^j b u 

7=1 

£>i(e) = Diag(ai(e),...,a n (e)) 
D 2 (e) = Dmg(b 1 (e),...,b n (e)). 



Then 

(eA + £>i(e))l = a and (eB + D 2 (e))\ = b 

where 1 = (1,..., l) r . 

By the same argument as in the proof of Lemma [3TT~l we see that eA + £>i(e) is non- 
singular if 6 > is sufficiently small and if b\ja\, . . . , b n /a n are distinct each other, we 
can take e so that (eA + D\(e))~ l (eB + D 2 (e)) has n distinct eigenvalues in F. 

Therefore, it is enough to set X = (l/e)Di(e), Y = (1 /e)D 2 (e) and p = el.t 
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Lemma 4.7 Let (A\ ; A 2 ) be an m x n x 2 tensor with m < n. Set Ai = (a,i , . . . , a,„) for 
i = 1,2. Suppose (Ai)< m is non-singular and ((A 1 )< m )" 1 (A 2 )< m has m distinct eigenvalues. 
Suppose also that there are integers j\, . . ., j s with m < ji < ■ ■ ■ < j s < n and m- 
dimensional vectors p\, p s such that 

(Ai)<mPt = dij, for i = 1,2, t = 1,2,..., s. 

Then rank^A^ A 2 ) < n - s. 

Proof Let V be the nxn upper triangular unipotent matrix whose j-th column is | ^j +e j, 

if j = j t for some t and ej otherwise. 

Then ji, j 2 , . . . , j s -th column of AjV is zero by the assumption and therefore we see 
by Lemma [3731 that 

rank F (Ai;A 2 ) = rank F (Ai V; A 2 V) <n - s, 
since (Ai V; A 2 V) is essentially an m x (n - s) x 2 tensor. I 
Now we state the following 

Theorem 4.8 If m < n then max.rank F (m, n, 3) < m + n - 1. 

Proof We prove for an arbitrary m X n X 3 tensor T = (Ai ; A 2 ; A 3 ), rank F r < m + n - 1 . 

Set r = maxjrankA | A e <Ai,A 2 ,A 3 )}. Then by Lemma [2~3l we may assume that 
A 3 = (Diag(£V, O), O) and supp(Ai) D supp(A 2 ). 

Set Ai = (an, . .., a in ) for i = 1,2. If there is j > m such that a\j = 0, then, since 
we are assuming that supp^) D supp(A 2 ), T is essentially an m x (n - 1) x 3 tensor. So 
rank F r < m + n - 1 by Lemma l3~3l 

Now assume that a.\ } ^ for any j > m. 

We first consider the case where a\j, a 2 j are linearly dependent for any j with j > m. 
Since the vector space spanned by the column vectors of (A\)< m+X is at most m and the 
last column of (Ai)< m+ i is not zero, we see that there is j with 1 < j < m such that 
j'-th column vector of A x is a linear combination of the column vectors of ;< (Ai)^ OT+1 . 
Therefore we see that there is an (m + 1) x (m + 1) lower triangular unipotent matrix V 
such that (((Ai)< m+ i)V)< m has a column vector which is 0. So we see by Theorem |4~51 

rank F r 

= rank F (A!Diag(K E n - m _i); A 2 Diag(V, E n _ m _ x ); A 3 Diag(K E n _ m _ x )) 

< rankF^CAO^+iV)^; ((A 2 )< m+1 y)< m ; ((A 3 )< m+1 V)< m ) 

n 

+ 2^ rank F (fli ; ;a 2j ;0) 

j=m+l 

< 2m - 1 + n — m 
= m + n - 1, 

since a\j, a 2 j are linearly dependent for j > m. 

From now on, we assume that there is j with j > m such that a\j, a 2j are linearly 
independent. 
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We first consider the case where r = m. By Lemma l4~2l we see that there is a non- 
singular m x m matrix P such that any entry of Pay and any 2-minor of P(a\j,a 2} ) is 
not zero. Set 5, = PAj-DiagCP, E n _ m )~ l and 5, = (b n , . . . ,b in ) for i = 1,2,3. Then 
i?3 = (E m , O) and every entry of b\j and every 2-minor of (by, by) is not zero. So by 
Lemma l4~6l we see that there are mxm diagonal matrices D\ and D 2 and an m-dimensional 
vector p such that 

((Bd<m + DdP = bij for i = 1,2, 
CBi)< m + is non- singular and 

((Bi)<m + Oi) _1 ((fi 2 )<m + D 2 ) has m distinct eigenvalues. 
Therefore by Lemma |4~771 we see that 

Tank F (B 1 + (Di,Oy,B 2 + (D 2 ,0))<n - 1. 

So 

rank F r 
= rank F (5 i;J B 2;J B3) 

< rankpCBj + (D u O); B 2 + (D 2 , 0)) + rank F (-(Di, O); -(D 2 , 0); (E m , O)) 

< n — 1 + m. 

Finally we consider the case where r < m. Since A 3 = (Diag(£V, O), O) and rank (tA 3 + 
A]) < r for any ? e F by the definition of r, we see that (i, j) £ supp(A]) if i > r and j > r. 

If the (r + l)-th row of A\ is zero, then (At; A 2 ;A 3 ) is essentially an(m-l)xnx3 
tensor. So 

rank F (Ai; A 2 ; A 3 ) < m - 1 + n 

by Lemma l3~3l Therefore we may assume that (r + 1 )-th row of A { is not zero. Take j with 
j > m such that ay, a 2 j are linearly independent. Exchanging the (r + l)-th and the j'-th 
columns of A,, we may assume that at >r +t, «2,r+i are linearly independent. By applying 
Lemma WA\ to (Ai)^J and (A 2 )<^J, we see that there is a non-singular r x r matrix 
P such that DiagC/UXAO^+jDiagCP, l)" 1 and Diag(P, l)(A 2 )^}Diag(P, l)" 1 satisfy the 
condition of (b) in Lemma I3T1 Set 5, = Dmg(P, £ , m _ r )A,Diag(i 5 , E n _ r )~ l for i = 1,2,3. 
Then B 3 = (Diag(£ r , O), O) and, (Bt)f r l\ and (B 2 )% r r \\, satisfy the condition (b) in Lemma 
ED 

Let C, be the m x n matrix obtained by exchanging the (r + l)-th and m-th rows and 
columns and r-th and (m - l)-th rows and columns of B t respectively for i = 1, 2, 3. Then 
(Ct)< m and (C 2 )< m satisfy the condition of (b) in Lemma lBTTI and C 3 = (Diag(£ r _i, 0, 1,0), O). 
Therefore we see that 

rank F r = rank F (Ci; C 2 ; C 3 ) < m + n - 1 

by Lemma 1431 I 

Finally we state some upper bounds of the maximal rank for small tensors which are 
direct consequences of Theorem 14 .51 
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Proposition 4.9 The fallowings are true. 



(1) max.rank F (3, 3, 3) < 5 

(2) max.rank c (4,4,3) < 7 

(3) max.rank]F(5, 5, 3) < 9 

(4) max.rank c (6, 6, 3) < 11 



It is possible that there is no non-zero singular matrix in (Ai,A 2 ,A 3 ) over the real 



number field. For example, let A] = 



< 1 

-1 











-1 



0^ 


1 

oj 



,A 2 = 



< 



-1 

-1 





1 












oj 



andA 3 = E 4 . 



2\2 



Since the determinant of xA x + yA 2 + zA 3 is (x + y + z ) 
only when x = y = z = 0. 



xAy + yA 2 + zAi is singular 
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